Pandas Profiling Report

Dataset statistics

Number of variables	24
Number of observations	30000
Missing cells	0
Missing cells (%)	0.0%
Duplicate rows	35
Duplicate rows (%)	0.1%
Total size in memory	6.7 MiB
Average record size in memory	235.2 B

Variable types

Numeric	21
Categorical	3

Alerts

Dataset has 35 (0.1%) duplicate rows	Duplicates
`PAY_0` is highly overall correlated with `PAY_2` and 5 other fields	High correlation
`PAY_2` is highly overall correlated with `PAY_0` and 4 other fields	High correlation
`PAY_3` is highly overall correlated with `PAY_0` and 4 other fields	High correlation
`PAY_4` is highly overall correlated with `PAY_0` and 4 other fields	High correlation
`PAY_5` is highly overall correlated with `PAY_0` and 5 other fields	High correlation
`PAY_6` is highly overall correlated with `PAY_0` and 5 other fields	High correlation
`BILL_AMT1` is highly overall correlated with `LIMIT_BAL` and 6 other fields	High correlation
`BILL_AMT2` is highly overall correlated with `LIMIT_BAL` and 6 other fields	High correlation
`BILL_AMT3` is highly overall correlated with `BILL_AMT1` and 6 other fields	High correlation
`BILL_AMT4` is highly overall correlated with `LIMIT_BAL` and 6 other fields	High correlation
`BILL_AMT5` is highly overall correlated with `LIMIT_BAL` and 8 other fields	High correlation
`BILL_AMT6` is highly overall correlated with `LIMIT_BAL` and 6 other fields	High correlation
`PAY_AMT1` is highly overall correlated with `PAY_AMT2` and 2 other fields	High correlation
`PAY_AMT2` is highly overall correlated with `BILL_AMT3` and 3 other fields	High correlation
`PAY_AMT3` is highly overall correlated with `LIMIT_BAL` and 8 other fields	High correlation
`PAY_AMT4` is highly overall correlated with `PAY_AMT1` and 1 other fields	High correlation
`PAY_AMT5` is highly overall correlated with `BILL_AMT3` and 1 other fields	High correlation
`PAY_AMT6` is highly overall correlated with `BILL_AMT5` and 4 other fields	High correlation
`LIMIT_BAL` is highly overall correlated with `BILL_AMT1` and 5 other fields	High correlation
`default.payment.next.month` is highly overall correlated with `PAY_0`	High correlation
`PAY_AMT2` is highly skewed (γ1 = 30.45381745)	Skewed
`PAY_0` has 14737 (49.1%) zeros	Zeros
`PAY_2` has 15730 (52.4%) zeros	Zeros
`PAY_3` has 15764 (52.5%) zeros	Zeros
`PAY_4` has 16455 (54.9%) zeros	Zeros
`PAY_5` has 16947 (56.5%) zeros	Zeros
`PAY_6` has 16286 (54.3%) zeros	Zeros
`BILL_AMT1` has 2008 (6.7%) zeros	Zeros
`BILL_AMT2` has 2506 (8.4%) zeros	Zeros
`BILL_AMT3` has 2870 (9.6%) zeros	Zeros
`BILL_AMT4` has 3195 (10.7%) zeros	Zeros
`BILL_AMT5` has 3506 (11.7%) zeros	Zeros
`BILL_AMT6` has 4020 (13.4%) zeros	Zeros
`PAY_AMT1` has 5249 (17.5%) zeros	Zeros
`PAY_AMT2` has 5396 (18.0%) zeros	Zeros
`PAY_AMT3` has 5968 (19.9%) zeros	Zeros
`PAY_AMT4` has 6408 (21.4%) zeros	Zeros
`PAY_AMT5` has 6703 (22.3%) zeros	Zeros
`PAY_AMT6` has 7173 (23.9%) zeros	Zeros

Reproduction

Analysis started	2023-04-22 08:13:31.924886
Analysis finished	2023-04-22 08:15:10.665928
Duration	1 minute and 38.74 seconds
Software version	pandas-profiling vv3.5.0
Download configuration	config.json

LIMIT_BAL
Real number (ℝ)

Distinct	81
Distinct (%)	0.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	167484.32

Minimum	10000
Maximum	1000000
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	10000
5-th percentile	20000
Q1	50000
median	140000
Q3	240000
95-th percentile	430000
Maximum	1000000
Range	990000
Interquartile range (IQR)	190000

Descriptive statistics

Standard deviation	129747.66
Coefficient of variation (CV)	0.77468541
Kurtosis	0.5362629
Mean	167484.32
Median Absolute Deviation (MAD)	90000
Skewness	0.99286696
Sum	5.0245297 × 10⁹
Variance	1.6834456 × 10¹⁰
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
50000	3365	11.2%
20000	1976	6.6%
30000	1610	5.4%
80000	1567	5.2%
200000	1528	5.1%
150000	1110	3.7%
100000	1048	3.5%
180000	995	3.3%
360000	881	2.9%
60000	825	2.8%
Other values (71)	15095	50.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
10000	493	1.6%
16000	2	< 0.1%
20000	1976	6.6%
30000	1610	5.4%
40000	230	0.8%
50000	3365	11.2%
60000	825	2.8%
70000	731	2.4%
80000	1567	5.2%
90000	651	2.2%

Value	Count	Frequency (%)
1000000	1	< 0.1%
800000	2	< 0.1%
780000	2	< 0.1%
760000	1	< 0.1%
750000	4	< 0.1%
740000	2	< 0.1%
730000	2	< 0.1%
720000	3	< 0.1%
710000	6	< 0.1%
700000	8	< 0.1%

SEX
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

2	18112
1	11888

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	30000
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	2
2nd row	2
3rd row	2
4th row	2
5th row	1

Common Values

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

Most occurring characters

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	30000	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

Most occurring scripts

Value	Count	Frequency (%)
Common	30000	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	30000	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
2	18112	60.4%
1	11888	39.6%

EDUCATION
Real number (ℝ)

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.8531333

Minimum	0
Maximum	6
Zeros	14
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	1
Q1	1
median	2
Q3	2
95-th percentile	3
Maximum	6
Range	6
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	0.79034866
Coefficient of variation (CV)	0.42649314
Kurtosis	2.0786216
Mean	1.8531333
Median Absolute Deviation (MAD)	1
Skewness	0.97097205
Sum	55594
Variance	0.624651
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
2	14030	46.8%
1	10585	35.3%
3	4917	16.4%
5	280	0.9%
4	123	0.4%
6	51	0.2%
0	14	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	14	< 0.1%
1	10585	35.3%
2	14030	46.8%
3	4917	16.4%
4	123	0.4%
5	280	0.9%
6	51	0.2%

Value	Count	Frequency (%)
6	51	0.2%
5	280	0.9%
4	123	0.4%
3	4917	16.4%
2	14030	46.8%
1	10585	35.3%
0	14	< 0.1%

MARRIAGE
Categorical

Distinct	4
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

2	15964
1	13659
3	323
0	54

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	30000
Distinct characters	4
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	2
3rd row	2
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

Most occurring characters

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	30000	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

Most occurring scripts

Value	Count	Frequency (%)
Common	30000	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	30000	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
2	15964	53.2%
1	13659	45.5%
3	323	1.1%
0	54	0.2%

AGE
Real number (ℝ)

Distinct	56
Distinct (%)	0.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	35.4855

Minimum	21
Maximum	79
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	21
5-th percentile	23
Q1	28
median	34
Q3	41
95-th percentile	53
Maximum	79
Range	58
Interquartile range (IQR)	13

Descriptive statistics

Standard deviation	9.2179041
Coefficient of variation (CV)	0.25976537
Kurtosis	0.044303378
Mean	35.4855
Median Absolute Deviation (MAD)	6
Skewness	0.73224587
Sum	1064565
Variance	84.969755
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
29	1605	5.3%
27	1477	4.9%
28	1409	4.7%
30	1395	4.7%
26	1256	4.2%
31	1217	4.1%
25	1186	4.0%
34	1162	3.9%
32	1158	3.9%
33	1146	3.8%
Other values (46)	16989	56.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
21	67	0.2%
22	560	1.9%
23	931	3.1%
24	1127	3.8%
25	1186	4.0%
26	1256	4.2%
27	1477	4.9%
28	1409	4.7%
29	1605	5.3%
30	1395	4.7%

Value	Count	Frequency (%)
79	1	< 0.1%
75	3	< 0.1%
74	1	< 0.1%
73	4	< 0.1%
72	3	< 0.1%
71	3	< 0.1%
70	10	< 0.1%
69	15	0.1%
68	5	< 0.1%
67	16	0.1%

PAY_0
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.0167

Minimum	-2
Maximum	8
Zeros	14737
Zeros (%)	49.1%
Negative	8445
Negative (%)	28.1%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.1238015
Coefficient of variation (CV)	-67.293505
Kurtosis	2.720715
Mean	-0.0167
Median Absolute Deviation (MAD)	1
Skewness	0.73197493
Sum	-501
Variance	1.2629299
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
0	14737	49.1%
-1	5686	19.0%
1	3688	12.3%
-2	2759	9.2%
2	2667	8.9%
3	322	1.1%
4	76	0.3%
5	26	0.1%
8	19	0.1%
6	11	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	2759	9.2%
-1	5686	19.0%
0	14737	49.1%
1	3688	12.3%
2	2667	8.9%
3	322	1.1%
4	76	0.3%
5	26	0.1%
6	11	< 0.1%
7	9	< 0.1%

Value	Count	Frequency (%)
8	19	0.1%
7	9	< 0.1%
6	11	< 0.1%
5	26	0.1%
4	76	0.3%
3	322	1.1%
2	2667	8.9%
1	3688	12.3%
0	14737	49.1%
-1	5686	19.0%

PAY_2
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.13376667

Minimum	-2
Maximum	8
Zeros	15730
Zeros (%)	52.4%
Negative	9832
Negative (%)	32.8%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.197186
Coefficient of variation (CV)	-8.9498079
Kurtosis	1.5704177
Mean	-0.13376667
Median Absolute Deviation (MAD)	0
Skewness	0.79056502
Sum	-4013
Variance	1.4332543
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
0	15730	52.4%
-1	6050	20.2%
2	3927	13.1%
-2	3782	12.6%
3	326	1.1%
4	99	0.3%
1	28	0.1%
5	25	0.1%
7	20	0.1%
6	12	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	3782	12.6%
-1	6050	20.2%
0	15730	52.4%
1	28	0.1%
2	3927	13.1%
3	326	1.1%
4	99	0.3%
5	25	0.1%
6	12	< 0.1%
7	20	0.1%

Value	Count	Frequency (%)
8	1	< 0.1%
7	20	0.1%
6	12	< 0.1%
5	25	0.1%
4	99	0.3%
3	326	1.1%
2	3927	13.1%
1	28	0.1%
0	15730	52.4%
-1	6050	20.2%

PAY_3
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.1662

Minimum	-2
Maximum	8
Zeros	15764
Zeros (%)	52.5%
Negative	10023
Negative (%)	33.4%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.1968676
Coefficient of variation (CV)	-7.2013692
Kurtosis	2.0844359
Mean	-0.1662
Median Absolute Deviation (MAD)	0
Skewness	0.84068183
Sum	-4986
Variance	1.432492
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
0	15764	52.5%
-1	5938	19.8%
-2	4085	13.6%
2	3819	12.7%
3	240	0.8%
4	76	0.3%
7	27	0.1%
6	23	0.1%
5	21	0.1%
1	4	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	4085	13.6%
-1	5938	19.8%
0	15764	52.5%
1	4	< 0.1%
2	3819	12.7%
3	240	0.8%
4	76	0.3%
5	21	0.1%
6	23	0.1%
7	27	0.1%

Value	Count	Frequency (%)
8	3	< 0.1%
7	27	0.1%
6	23	0.1%
5	21	0.1%
4	76	0.3%
3	240	0.8%
2	3819	12.7%
1	4	< 0.1%
0	15764	52.5%
-1	5938	19.8%

PAY_4
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	11
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.22066667

Minimum	-2
Maximum	8
Zeros	16455
Zeros (%)	54.9%
Negative	10035
Negative (%)	33.5%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.1691386
Coefficient of variation (CV)	-5.2982113
Kurtosis	3.4969835
Mean	-0.22066667
Median Absolute Deviation (MAD)	0
Skewness	0.99962941
Sum	-6620
Variance	1.3668851
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=11)

Value	Count	Frequency (%)
0	16455	54.9%
-1	5687	19.0%
-2	4348	14.5%
2	3159	10.5%
3	180	0.6%
4	69	0.2%
7	58	0.2%
5	35	0.1%
6	5	< 0.1%
1	2	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	4348	14.5%
-1	5687	19.0%
0	16455	54.9%
1	2	< 0.1%
2	3159	10.5%
3	180	0.6%
4	69	0.2%
5	35	0.1%
6	5	< 0.1%
7	58	0.2%

Value	Count	Frequency (%)
8	2	< 0.1%
7	58	0.2%
6	5	< 0.1%
5	35	0.1%
4	69	0.2%
3	180	0.6%
2	3159	10.5%
1	2	< 0.1%
0	16455	54.9%
-1	5687	19.0%

PAY_5
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	10
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.2662

Minimum	-2
Maximum	8
Zeros	16947
Zeros (%)	56.5%
Negative	10085
Negative (%)	33.6%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.1331874
Coefficient of variation (CV)	-4.2569024
Kurtosis	3.9897481
Mean	-0.2662
Median Absolute Deviation (MAD)	0
Skewness	1.008197
Sum	-7986
Variance	1.2841137
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	16947	56.5%
-1	5539	18.5%
-2	4546	15.2%
2	2626	8.8%
3	178	0.6%
4	84	0.3%
7	58	0.2%
5	17	0.1%
6	4	< 0.1%
8	1	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	4546	15.2%
-1	5539	18.5%
0	16947	56.5%
2	2626	8.8%
3	178	0.6%
4	84	0.3%
5	17	0.1%
6	4	< 0.1%
7	58	0.2%
8	1	< 0.1%

Value	Count	Frequency (%)
8	1	< 0.1%
7	58	0.2%
6	4	< 0.1%
5	17	0.1%
4	84	0.3%
3	178	0.6%
2	2626	8.8%
0	16947	56.5%
-1	5539	18.5%
-2	4546	15.2%

PAY_6
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	10
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	-0.2911

Minimum	-2
Maximum	8
Zeros	16286
Zeros (%)	54.3%
Negative	10635
Negative (%)	35.4%
Memory size	468.8 KiB

Quantile statistics

Minimum	-2
5-th percentile	-2
Q1	-1
median	0
Q3	0
95-th percentile	2
Maximum	8
Range	10
Interquartile range (IQR)	1

Descriptive statistics

Standard deviation	1.1499876
Coefficient of variation (CV)	-3.95049
Kurtosis	3.4265341
Mean	-0.2911
Median Absolute Deviation (MAD)	0
Skewness	0.94802939
Sum	-8733
Variance	1.3224715
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=10)

Value	Count	Frequency (%)
0	16286	54.3%
-1	5740	19.1%
-2	4895	16.3%
2	2766	9.2%
3	184	0.6%
4	49	0.2%
7	46	0.2%
6	19	0.1%
5	13	< 0.1%
8	2	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-2	4895	16.3%
-1	5740	19.1%
0	16286	54.3%
2	2766	9.2%
3	184	0.6%
4	49	0.2%
5	13	< 0.1%
6	19	0.1%
7	46	0.2%
8	2	< 0.1%

Value	Count	Frequency (%)
8	2	< 0.1%
7	46	0.2%
6	19	0.1%
5	13	< 0.1%
4	49	0.2%
3	184	0.6%
2	2766	9.2%
0	16286	54.3%
-1	5740	19.1%
-2	4895	16.3%

BILL_AMT1
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	22723
Distinct (%)	75.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	51223.331

Minimum	-165580
Maximum	964511
Zeros	2008
Zeros (%)	6.7%
Negative	590
Negative (%)	2.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	-165580
5-th percentile	0
Q1	3558.75
median	22381.5
Q3	67091
95-th percentile	201203.05
Maximum	964511
Range	1130091
Interquartile range (IQR)	63532.25

Descriptive statistics

Standard deviation	73635.861
Coefficient of variation (CV)	1.4375453
Kurtosis	9.8062893
Mean	51223.331
Median Absolute Deviation (MAD)	21800.5
Skewness	2.663861
Sum	1.5366999 × 10⁹
Variance	5.42224 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2008	6.7%
390	244	0.8%
780	76	0.3%
326	72	0.2%
316	63	0.2%
2500	59	0.2%
396	49	0.2%
2400	39	0.1%
416	29	0.1%
500	25	0.1%
Other values (22713)	27336	91.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-165580	1	< 0.1%
-154973	1	< 0.1%
-15308	1	< 0.1%
-14386	1	< 0.1%
-11545	1	< 0.1%
-10682	1	< 0.1%
-9802	1	< 0.1%
-9095	1	< 0.1%
-8187	1	< 0.1%
-7438	1	< 0.1%

Value	Count	Frequency (%)
964511	1	< 0.1%
746814	1	< 0.1%
653062	1	< 0.1%
630458	1	< 0.1%
626648	1	< 0.1%
621749	1	< 0.1%
613860	1	< 0.1%
610723	1	< 0.1%
608594	1	< 0.1%
604019	1	< 0.1%

BILL_AMT2
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	22346
Distinct (%)	74.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	49179.075

Minimum	-69777
Maximum	983931
Zeros	2506
Zeros (%)	8.4%
Negative	669
Negative (%)	2.2%
Memory size	468.8 KiB

Quantile statistics

Minimum	-69777
5-th percentile	0
Q1	2984.75
median	21200
Q3	64006.25
95-th percentile	194792.2
Maximum	983931
Range	1053708
Interquartile range (IQR)	61021.5

Descriptive statistics

Standard deviation	71173.769
Coefficient of variation (CV)	1.4472368
Kurtosis	10.302946
Mean	49179.075
Median Absolute Deviation (MAD)	20810
Skewness	2.7052209
Sum	1.4753723 × 10⁹
Variance	5.0657054 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2506	8.4%
390	231	0.8%
326	75	0.2%
780	75	0.2%
316	72	0.2%
396	51	0.2%
2500	51	0.2%
2400	42	0.1%
-200	29	0.1%
416	28	0.1%
Other values (22336)	26840	89.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-69777	1	< 0.1%
-67526	1	< 0.1%
-33350	1	< 0.1%
-30000	1	< 0.1%
-26214	1	< 0.1%
-24704	1	< 0.1%
-24702	1	< 0.1%
-22960	1	< 0.1%
-18618	1	< 0.1%
-18088	1	< 0.1%

Value	Count	Frequency (%)
983931	1	< 0.1%
743970	1	< 0.1%
671563	1	< 0.1%
646770	1	< 0.1%
624475	1	< 0.1%
605943	1	< 0.1%
597793	1	< 0.1%
586825	1	< 0.1%
581775	1	< 0.1%
577681	1	< 0.1%

BILL_AMT3
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	22026
Distinct (%)	73.4%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	47013.155

Minimum	-157264
Maximum	1664089
Zeros	2870
Zeros (%)	9.6%
Negative	655
Negative (%)	2.2%
Memory size	468.8 KiB

Quantile statistics

Minimum	-157264
5-th percentile	0
Q1	2666.25
median	20088.5
Q3	60164.75
95-th percentile	187821.05
Maximum	1664089
Range	1821353
Interquartile range (IQR)	57498.5

Descriptive statistics

Standard deviation	69349.387
Coefficient of variation (CV)	1.475106
Kurtosis	19.783255
Mean	47013.155
Median Absolute Deviation (MAD)	19708.5
Skewness	3.08783
Sum	1.4103946 × 10⁹
Variance	4.8093375 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	2870	9.6%
390	275	0.9%
780	74	0.2%
326	63	0.2%
316	62	0.2%
396	48	0.2%
2500	40	0.1%
2400	39	0.1%
416	29	0.1%
200	27	0.1%
Other values (22016)	26473	88.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-157264	1	< 0.1%
-61506	1	< 0.1%
-46127	1	< 0.1%
-34041	1	< 0.1%
-25443	1	< 0.1%
-24702	1	< 0.1%
-20320	1	< 0.1%
-17706	1	< 0.1%
-15910	1	< 0.1%
-15641	1	< 0.1%

Value	Count	Frequency (%)
1664089	1	< 0.1%
855086	1	< 0.1%
693131	1	< 0.1%
689643	1	< 0.1%
689627	1	< 0.1%
632041	1	< 0.1%
597415	1	< 0.1%
578971	1	< 0.1%
577957	1	< 0.1%
577015	1	< 0.1%

BILL_AMT4
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	21548
Distinct (%)	71.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	43262.949

Minimum	-170000
Maximum	891586
Zeros	3195
Zeros (%)	10.7%
Negative	675
Negative (%)	2.2%
Memory size	468.8 KiB

Quantile statistics

Minimum	-170000
5-th percentile	0
Q1	2326.75
median	19052
Q3	54506
95-th percentile	174333.35
Maximum	891586
Range	1061586
Interquartile range (IQR)	52179.25

Descriptive statistics

Standard deviation	64332.856
Coefficient of variation (CV)	1.4870197
Kurtosis	11.309325
Mean	43262.949
Median Absolute Deviation (MAD)	18656
Skewness	2.8219653
Sum	1.2978885 × 10⁹
Variance	4.1387164 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3195	10.7%
390	246	0.8%
780	101	0.3%
316	68	0.2%
326	62	0.2%
396	44	0.1%
2400	39	0.1%
150	39	0.1%
2500	34	0.1%
416	33	0.1%
Other values (21538)	26139	87.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-170000	1	< 0.1%
-81334	1	< 0.1%
-65167	1	< 0.1%
-50616	1	< 0.1%
-46627	1	< 0.1%
-34503	1	< 0.1%
-27490	1	< 0.1%
-24303	1	< 0.1%
-22108	1	< 0.1%
-20320	1	< 0.1%

Value	Count	Frequency (%)
891586	1	< 0.1%
706864	1	< 0.1%
628699	1	< 0.1%
616836	1	< 0.1%
572805	1	< 0.1%
569034	1	< 0.1%
565669	1	< 0.1%
563543	1	< 0.1%
548020	1	< 0.1%
542653	1	< 0.1%

BILL_AMT5
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	21010
Distinct (%)	70.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	40311.401

Minimum	-81334
Maximum	927171
Zeros	3506
Zeros (%)	11.7%
Negative	655
Negative (%)	2.2%
Memory size	468.8 KiB

Quantile statistics

Minimum	-81334
5-th percentile	0
Q1	1763
median	18104.5
Q3	50190.5
95-th percentile	165794.3
Maximum	927171
Range	1008505
Interquartile range (IQR)	48427.5

Descriptive statistics

Standard deviation	60797.156
Coefficient of variation (CV)	1.5081876
Kurtosis	12.305881
Mean	40311.401
Median Absolute Deviation (MAD)	17688.5
Skewness	2.8763799
Sum	1.209342 × 10⁹
Variance	3.6962941 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	3506	11.7%
390	235	0.8%
780	94	0.3%
316	79	0.3%
326	62	0.2%
150	58	0.2%
396	47	0.2%
2400	39	0.1%
2500	37	0.1%
416	36	0.1%
Other values (21000)	25807	86.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-81334	1	< 0.1%
-61372	1	< 0.1%
-53007	1	< 0.1%
-46627	1	< 0.1%
-37594	1	< 0.1%
-36156	1	< 0.1%
-30481	1	< 0.1%
-28335	1	< 0.1%
-23003	1	< 0.1%
-20753	1	< 0.1%

Value	Count	Frequency (%)
927171	1	< 0.1%
823540	1	< 0.1%
587067	1	< 0.1%
551702	1	< 0.1%
547880	1	< 0.1%
530672	1	< 0.1%
524315	1	< 0.1%
516139	1	< 0.1%
514114	1	< 0.1%
508213	1	< 0.1%

BILL_AMT6
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	20604
Distinct (%)	68.7%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	38871.76

Minimum	-339603
Maximum	961664
Zeros	4020
Zeros (%)	13.4%
Negative	688
Negative (%)	2.3%
Memory size	468.8 KiB

Quantile statistics

Minimum	-339603
5-th percentile	0
Q1	1256
median	17071
Q3	49198.25
95-th percentile	161912
Maximum	961664
Range	1301267
Interquartile range (IQR)	47942.25

Descriptive statistics

Standard deviation	59554.108
Coefficient of variation (CV)	1.5320661
Kurtosis	12.270705
Mean	38871.76
Median Absolute Deviation (MAD)	16755
Skewness	2.8466446
Sum	1.1661528 × 10⁹
Variance	3.5466917 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	4020	13.4%
390	207	0.7%
780	86	0.3%
150	78	0.3%
316	77	0.3%
326	56	0.2%
396	45	0.1%
416	36	0.1%
-18	33	0.1%
2400	32	0.1%
Other values (20594)	25330	84.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
-339603	1	< 0.1%
-209051	1	< 0.1%
-150953	1	< 0.1%
-94625	1	< 0.1%
-73895	1	< 0.1%
-57060	1	< 0.1%
-51443	1	< 0.1%
-51183	1	< 0.1%
-46627	1	< 0.1%
-45734	1	< 0.1%

Value	Count	Frequency (%)
961664	1	< 0.1%
699944	1	< 0.1%
568638	1	< 0.1%
527711	1	< 0.1%
527566	1	< 0.1%
514975	1	< 0.1%
513798	1	< 0.1%
511905	1	< 0.1%
501370	1	< 0.1%
499100	1	< 0.1%

PAY_AMT1
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	7943
Distinct (%)	26.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5663.5805

Minimum	0
Maximum	873552
Zeros	5249
Zeros (%)	17.5%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1000
median	2100
Q3	5006
95-th percentile	18428.2
Maximum	873552
Range	873552
Interquartile range (IQR)	4006

Descriptive statistics

Standard deviation	16563.28
Coefficient of variation (CV)	2.9245246
Kurtosis	415.25474
Mean	5663.5805
Median Absolute Deviation (MAD)	1932
Skewness	14.668364
Sum	1.6990742 × 10⁸
Variance	2.7434226 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5249	17.5%
2000	1363	4.5%
3000	891	3.0%
5000	698	2.3%
1500	507	1.7%
4000	426	1.4%
10000	401	1.3%
1000	365	1.2%
2500	298	1.0%
6000	294	1.0%
Other values (7933)	19508	65.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5249	17.5%
1	9	< 0.1%
2	14	< 0.1%
3	15	0.1%
4	18	0.1%
5	12	< 0.1%
6	15	0.1%
7	9	< 0.1%
8	8	< 0.1%
9	7	< 0.1%

Value	Count	Frequency (%)
873552	1	< 0.1%
505000	1	< 0.1%
493358	1	< 0.1%
423903	1	< 0.1%
405016	1	< 0.1%
368199	1	< 0.1%
323014	1	< 0.1%
304815	1	< 0.1%
302000	1	< 0.1%
300039	1	< 0.1%

PAY_AMT2
Real number (ℝ)

HIGH CORRELATION
SKEWED
ZEROS

Distinct	7899
Distinct (%)	26.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5921.1635

Minimum	0
Maximum	1684259
Zeros	5396
Zeros (%)	18.0%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	833
median	2009
Q3	5000
95-th percentile	19004.35
Maximum	1684259
Range	1684259
Interquartile range (IQR)	4167

Descriptive statistics

Standard deviation	23040.87
Coefficient of variation (CV)	3.8912741
Kurtosis	1641.6319
Mean	5921.1635
Median Absolute Deviation (MAD)	1991
Skewness	30.453817
Sum	1.776349 × 10⁸
Variance	5.3088171 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5396	18.0%
2000	1290	4.3%
3000	857	2.9%
5000	717	2.4%
1000	594	2.0%
1500	521	1.7%
4000	410	1.4%
10000	318	1.1%
6000	283	0.9%
2500	251	0.8%
Other values (7889)	19363	64.5%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5396	18.0%
1	15	0.1%
2	20	0.1%
3	18	0.1%
4	11	< 0.1%
5	25	0.1%
6	8	< 0.1%
7	12	< 0.1%
8	9	< 0.1%
9	6	< 0.1%

Value	Count	Frequency (%)
1684259	1	< 0.1%
1227082	1	< 0.1%
1215471	1	< 0.1%
1024516	1	< 0.1%
580464	1	< 0.1%
415552	1	< 0.1%
401003	1	< 0.1%
388126	1	< 0.1%
385228	1	< 0.1%
384986	1	< 0.1%

PAY_AMT3
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	7518
Distinct (%)	25.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5225.6815

Minimum	0
Maximum	896040
Zeros	5968
Zeros (%)	19.9%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	390
median	1800
Q3	4505
95-th percentile	17589.4
Maximum	896040
Range	896040
Interquartile range (IQR)	4115

Descriptive statistics

Standard deviation	17606.961
Coefficient of variation (CV)	3.3693139
Kurtosis	564.31123
Mean	5225.6815
Median Absolute Deviation (MAD)	1795
Skewness	17.216635
Sum	1.5677044 × 10⁸
Variance	3.1000509 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	5968	19.9%
2000	1285	4.3%
1000	1103	3.7%
3000	870	2.9%
5000	721	2.4%
1500	490	1.6%
4000	381	1.3%
10000	312	1.0%
1200	243	0.8%
6000	241	0.8%
Other values (7508)	18386	61.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	5968	19.9%
1	13	< 0.1%
2	19	0.1%
3	14	< 0.1%
4	15	0.1%
5	18	0.1%
6	14	< 0.1%
7	18	0.1%
8	10	< 0.1%
9	12	< 0.1%

Value	Count	Frequency (%)
896040	1	< 0.1%
889043	1	< 0.1%
508229	1	< 0.1%
417588	1	< 0.1%
400972	1	< 0.1%
397092	1	< 0.1%
380478	1	< 0.1%
371718	1	< 0.1%
349395	1	< 0.1%
344261	1	< 0.1%

PAY_AMT4
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	6937
Distinct (%)	23.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4826.0769

Minimum	0
Maximum	621000
Zeros	6408
Zeros (%)	21.4%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	296
median	1500
Q3	4013.25
95-th percentile	16014.95
Maximum	621000
Range	621000
Interquartile range (IQR)	3717.25

Descriptive statistics

Standard deviation	15666.16
Coefficient of variation (CV)	3.246148
Kurtosis	277.33377
Mean	4826.0769
Median Absolute Deviation (MAD)	1500
Skewness	12.904985
Sum	1.4478231 × 10⁸
Variance	2.4542856 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	6408	21.4%
1000	1394	4.6%
2000	1214	4.0%
3000	887	3.0%
5000	810	2.7%
1500	441	1.5%
4000	402	1.3%
10000	341	1.1%
2500	259	0.9%
500	258	0.9%
Other values (6927)	17586	58.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6408	21.4%
1	22	0.1%
2	22	0.1%
3	13	< 0.1%
4	20	0.1%
5	12	< 0.1%
6	16	0.1%
7	11	< 0.1%
8	7	< 0.1%
9	9	< 0.1%

Value	Count	Frequency (%)
621000	1	< 0.1%
528897	1	< 0.1%
497000	1	< 0.1%
432130	1	< 0.1%
400046	1	< 0.1%
331788	1	< 0.1%
330982	1	< 0.1%
320008	1	< 0.1%
313094	1	< 0.1%
292962	1	< 0.1%

PAY_AMT5
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	6897
Distinct (%)	23.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	4799.3876

Minimum	0
Maximum	426529
Zeros	6703
Zeros (%)	22.3%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	252.5
median	1500
Q3	4031.5
95-th percentile	16000
Maximum	426529
Range	426529
Interquartile range (IQR)	3779

Descriptive statistics

Standard deviation	15278.306
Coefficient of variation (CV)	3.1833865
Kurtosis	180.06394
Mean	4799.3876
Median Absolute Deviation (MAD)	1500
Skewness	11.127417
Sum	1.4398163 × 10⁸
Variance	2.3342662 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	6703	22.3%
1000	1340	4.5%
2000	1323	4.4%
3000	947	3.2%
5000	814	2.7%
1500	426	1.4%
4000	401	1.3%
10000	343	1.1%
500	250	0.8%
6000	247	0.8%
Other values (6887)	17206	57.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6703	22.3%
1	21	0.1%
2	13	< 0.1%
3	13	< 0.1%
4	12	< 0.1%
5	9	< 0.1%
6	7	< 0.1%
7	9	< 0.1%
8	6	< 0.1%
9	6	< 0.1%

Value	Count	Frequency (%)
426529	1	< 0.1%
417990	1	< 0.1%
388071	1	< 0.1%
379267	1	< 0.1%
332000	1	< 0.1%
331788	1	< 0.1%
330982	1	< 0.1%
326889	1	< 0.1%
317077	1	< 0.1%
310135	1	< 0.1%

PAY_AMT6
Real number (ℝ)

HIGH CORRELATION
ZEROS

Distinct	6939
Distinct (%)	23.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	5215.5026

Minimum	0
Maximum	528666
Zeros	7173
Zeros (%)	23.9%
Negative	0
Negative (%)	0.0%
Memory size	468.8 KiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	117.75
median	1500
Q3	4000
95-th percentile	17343.8
Maximum	528666
Range	528666
Interquartile range (IQR)	3882.25

Descriptive statistics

Standard deviation	17777.466
Coefficient of variation (CV)	3.4085815
Kurtosis	167.16143
Mean	5215.5026
Median Absolute Deviation (MAD)	1500
Skewness	10.640727
Sum	1.5646508 × 10⁸
Variance	3.1603829 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	7173	23.9%
1000	1299	4.3%
2000	1295	4.3%
3000	914	3.0%
5000	808	2.7%
1500	439	1.5%
4000	411	1.4%
10000	356	1.2%
500	247	0.8%
6000	220	0.7%
Other values (6929)	16838	56.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	7173	23.9%
1	20	0.1%
2	9	< 0.1%
3	14	< 0.1%
4	12	< 0.1%
5	7	< 0.1%
6	6	< 0.1%
7	5	< 0.1%
8	6	< 0.1%
9	7	< 0.1%

Value	Count	Frequency (%)
528666	1	< 0.1%
527143	1	< 0.1%
443001	1	< 0.1%
422000	1	< 0.1%
403500	1	< 0.1%
377000	1	< 0.1%
372495	1	< 0.1%
351282	1	< 0.1%
345293	1	< 0.1%
308000	1	< 0.1%

default.payment.next.month
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	1.9 MiB

0	23364
1	6636

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	30000
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	1
3rd row	0
4th row	0
5th row	0

Common Values

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Most occurring characters

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	30000	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Most occurring scripts

Value	Count	Frequency (%)
Common	30000	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	30000	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
0	23364	77.9%
1	6636	22.1%

Auto

The auto setting is an interpretable pairwise column metric of the following mapping:

Variable_type-Variable_type : Method, Range
Categorical-Categorical : Cramer's V, [0,1]
Numerical-Categorical : Cramer's V, [0,1] (using a discretized numerical column)
Numerical-Numerical : Spearman's ρ, [-1,1]

The number of bins used in the discretization for the Numerical-Categorical column pair can be changed using config.correlations["auto"].n_bins. The number of bins affects the granularity of the association you wish to measure.

This configuration uses the recommended metric for each pair of columns.

Spearman's ρ

The Spearman's rank correlation coefficient (ρ) is a measure of monotonic correlation between two variables, and is therefore better in catching nonlinear monotonic correlations than Pearson's r. It's value lies between -1 and +1, -1 indicating total negative monotonic correlation, 0 indicating no monotonic correlation and 1 indicating total positive monotonic correlation.

To calculate ρ for two variables X and Y, one divides the covariance of the rank variables of X and Y by the product of their standard deviations.

Pearson's r

The Pearson's correlation coefficient (r) is a measure of linear correlation between two variables. It's value lies between -1 and +1, -1 indicating total negative linear correlation, 0 indicating no linear correlation and 1 indicating total positive linear correlation. Furthermore, r is invariant under separate changes in location and scale of the two variables, implying that for a linear function the angle to the x-axis does not affect r.

To calculate r for two variables X and Y, one divides the covariance of X and Y by the product of their standard deviations.

Kendall's τ

Similarly to Spearman's rank correlation coefficient, the Kendall rank correlation coefficient (τ) measures ordinal association between two variables. It's value lies between -1 and +1, -1 indicating total negative correlation, 0 indicating no correlation and 1 indicating total positive correlation.

To calculate τ for two variables X and Y, one determines the number of concordant and discordant pairs of observations. τ is given by the number of concordant pairs minus the discordant pairs divided by the total number of pairs.

Cramér's V (φc)

Cramér's V is an association measure for nominal random variables. The coefficient ranges from 0 to 1, with 0 indicating independence and 1 indicating perfect association. The empirical estimators used for Cramér's V have been proved to be biased, even for large samples. We use a bias-corrected measure that has been proposed by Bergsma in 2013 that can be found here.

Phik (φk)

Phik (φk) is a new and practical correlation coefficient that works consistently between categorical, ordinal and interval variables, captures non-linear dependency and reverts to the Pearson correlation coefficient in case of a bivariate normal input distribution. There is extensive documentation available here.

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	LIMIT_BAL	SEX	EDUCATION	MARRIAGE	AGE	PAY_0	PAY_2	PAY_3	PAY_4	PAY_5	PAY_6	BILL_AMT1	BILL_AMT2	BILL_AMT3	BILL_AMT4	BILL_AMT5	BILL_AMT6	PAY_AMT1	PAY_AMT2	PAY_AMT3	PAY_AMT4	PAY_AMT5	PAY_AMT6	default.payment.next.month
ID
1	20000.0	2	2	1	24	2	2	-1	-1	-2	-2	3913.0	3102.0	689.0	0.0	0.0	0.0	0.0	689.0	0.0	0.0	0.0	0.0	1
2	120000.0	2	2	2	26	-1	2	0	0	0	2	2682.0	1725.0	2682.0	3272.0	3455.0	3261.0	0.0	1000.0	1000.0	1000.0	0.0	2000.0	1
3	90000.0	2	2	2	34	0	0	0	0	0	0	29239.0	14027.0	13559.0	14331.0	14948.0	15549.0	1518.0	1500.0	1000.0	1000.0	1000.0	5000.0	0
4	50000.0	2	2	1	37	0	0	0	0	0	0	46990.0	48233.0	49291.0	28314.0	28959.0	29547.0	2000.0	2019.0	1200.0	1100.0	1069.0	1000.0	0
5	50000.0	1	2	1	57	-1	0	-1	0	0	0	8617.0	5670.0	35835.0	20940.0	19146.0	19131.0	2000.0	36681.0	10000.0	9000.0	689.0	679.0	0
6	50000.0	1	1	2	37	0	0	0	0	0	0	64400.0	57069.0	57608.0	19394.0	19619.0	20024.0	2500.0	1815.0	657.0	1000.0	1000.0	800.0	0
7	500000.0	1	1	2	29	0	0	0	0	0	0	367965.0	412023.0	445007.0	542653.0	483003.0	473944.0	55000.0	40000.0	38000.0	20239.0	13750.0	13770.0	0
8	100000.0	2	2	2	23	0	-1	-1	0	0	-1	11876.0	380.0	601.0	221.0	-159.0	567.0	380.0	601.0	0.0	581.0	1687.0	1542.0	0
9	140000.0	2	3	1	28	0	0	2	0	0	0	11285.0	14096.0	12108.0	12211.0	11793.0	3719.0	3329.0	0.0	432.0	1000.0	1000.0	1000.0	0
10	20000.0	1	3	2	35	-2	-2	-2	-2	-1	-1	0.0	0.0	0.0	0.0	13007.0	13912.0	0.0	0.0	0.0	13007.0	1122.0	0.0	0

	LIMIT_BAL	SEX	EDUCATION	MARRIAGE	AGE	PAY_0	PAY_2	PAY_3	PAY_4	PAY_5	PAY_6	BILL_AMT1	BILL_AMT2	BILL_AMT3	BILL_AMT4	BILL_AMT5	BILL_AMT6	PAY_AMT1	PAY_AMT2	PAY_AMT3	PAY_AMT4	PAY_AMT5	PAY_AMT6	default.payment.next.month
ID
29991	140000.0	1	2	1	41	0	0	0	0	0	0	138325.0	137142.0	139110.0	138262.0	49675.0	46121.0	6000.0	7000.0	4228.0	1505.0	2000.0	2000.0	0
29992	210000.0	1	2	1	34	3	2	2	2	2	2	2500.0	2500.0	2500.0	2500.0	2500.0	2500.0	0.0	0.0	0.0	0.0	0.0	0.0	1
29993	10000.0	1	3	1	43	0	0	0	-2	-2	-2	8802.0	10400.0	0.0	0.0	0.0	0.0	2000.0	0.0	0.0	0.0	0.0	0.0	0
29994	100000.0	1	1	2	38	0	-1	-1	0	0	0	3042.0	1427.0	102996.0	70626.0	69473.0	55004.0	2000.0	111784.0	4000.0	3000.0	2000.0	2000.0	0
29995	80000.0	1	2	2	34	2	2	2	2	2	2	72557.0	77708.0	79384.0	77519.0	82607.0	81158.0	7000.0	3500.0	0.0	7000.0	0.0	4000.0	1
29996	220000.0	1	3	1	39	0	0	0	0	0	0	188948.0	192815.0	208365.0	88004.0	31237.0	15980.0	8500.0	20000.0	5003.0	3047.0	5000.0	1000.0	0
29997	150000.0	1	3	2	43	-1	-1	-1	-1	0	0	1683.0	1828.0	3502.0	8979.0	5190.0	0.0	1837.0	3526.0	8998.0	129.0	0.0	0.0	0
29998	30000.0	1	2	2	37	4	3	2	-1	0	0	3565.0	3356.0	2758.0	20878.0	20582.0	19357.0	0.0	0.0	22000.0	4200.0	2000.0	3100.0	1
29999	80000.0	1	3	1	41	1	-1	0	0	0	-1	-1645.0	78379.0	76304.0	52774.0	11855.0	48944.0	85900.0	3409.0	1178.0	1926.0	52964.0	1804.0	1
30000	50000.0	1	2	1	46	0	0	0	0	0	0	47929.0	48905.0	49764.0	36535.0	32428.0	15313.0	2078.0	1800.0	1430.0	1000.0	1000.0	1000.0	1

Most frequently occurring

	LIMIT_BAL	SEX	EDUCATION	MARRIAGE	AGE	PAY_0	PAY_2	PAY_3	PAY_4	PAY_5	PAY_6	BILL_AMT1	BILL_AMT2	BILL_AMT3	BILL_AMT4	BILL_AMT5	BILL_AMT6	default.payment.next.month	# duplicates
0	20000.0	1	2	2	24	2	2	4	4	4	4	1650.0	1650.0	1650.0	1650.0	1650.0	1650.0	1	2
1	50000.0	1	2	2	26	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
2	50000.0	2	1	2	23	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
3	80000.0	2	2	1	31	-2	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
4	80000.0	2	2	2	25	-2	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
5	80000.0	2	3	1	42	-2	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
6	90000.0	2	1	2	31	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
7	100000.0	2	2	1	49	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
8	110000.0	2	1	2	31	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2
9	140000.0	1	1	2	29	1	-2	-2	-2	-2	-2	0.0	0.0	0.0	0.0	0.0	0.0	0	2

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Auto

Spearman's ρ

Pearson's r

Kendall's τ

Cramér's V (φc)

Phik (φk)

Missing values

Sample

Duplicate rows

Most frequently occurring